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COMMUNICATING USING A PARTIAL BLOCK IN A FRAME 



FIELD 

5 This disclosure relates to communicating using a partial block in a frame. 

BACKGROUND 

Various communication protocols are known for communicating between a sending 
device and a receiving device. Typically, the communication protocol in a data storage system 
10 defines a maximum frame size and various data blocks are transmitted within these frames 

between the sending device and receiving device. An integer number of data blocks are typically 
transmitted within each frame and in some instances this may be accomplished with relatively 
little unused space in the frame. 

However, as frame sizes change and/or the size of data blocks change, limiting the 
1 5 number of data blocks within a frame to an integer number may result in an increasing amount of 
unused space in the data frame. Hence, this results in a reduced utilization of the frame and 
increased system latency. 

BRIEF DESCRIPTION OF THE DRAWINGS 

20 Features and advantages of embodiments of the claimed subject matter will become 

apparent as the following Detailed Description proceeds, and upon reference to the Drawings, 
wherein like numerals depict like parts, and in which: 

FIG. 1 is a diagram of a system consistent with one embodiment of the invention; 
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FIG. 2A is a diagram of partial block communication circuitry that may be included in a 
circuit card comprised in the system of FIG. 1; 

FIG. 2B is an exemplary table that may be in stored in memory comprised in the circuitry 
of FIG. 2A; 

5 FIG. 3 A is a diagram of an exemplary sequence of data blocks inserted into associated 

frames where the size of a data block is less than a frame; 

FIG. 3B is a diagram of an exemplary protected data block of the sequence of FIG. 3 A; 

FIG. 4 is a diagram of another exemplary sequence of data blocks inserted into associated 
frames where the size of a data block is greater than a frame; and 

10 FIGs. 5 - 6 are flow charts illustrating operations consistent with embodiments. 

DETAILED DESCRIPTION 

FIG. 1 illustrates a system 100 consistent with an embodiment of the invention including 
a computer node having a host bus adapter (HBA), e.g., circuit card 120. The circuit card 120 is 
1 5 capable of communicating with one or more mass storage devices 1 04 via one or more 

communication links 106 using one or more communication protocols. Such communication 
- may take place by transmission of frames having at least one data block. As further detailed 
herein in operation of the system 100, one frame may contain a portion of a data block while 
another frame may contain another portion of the same data block. As such, in system 100, 
20 utilization of the frames may be more efficient, and system latency may be decreased, compared 
to the prior art. 
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The system 100 may also generally include a host processor 1 12, a bus 122, a user 
interface system 1 16, a chipset 1 14, system memory 121, a circuit card slot 130, and a circuit 
card 120 capable of communicating with one or more mass storage devices 104. The host 
processor 1 12 may include one or more processors known in the art such as an Intel ® Pentium 
5 ® IV processor commercially available from the Assignee of the subject application. The bus 
122 may include various bus types to transfer data and commands. For instance, the bus 122 
may comply with the Peripheral Component Interconnect (PCI) Express™ Base Specification 
Revision 1.0, published July 22, 2002, available from the PCI Special Interest Group, Portland, 
Oregon, U.S.A. (hereinafter referred to as a "PCI Express™ bus"). The bus 122 may 
10 alternatively comply with the PCI-X Specification Rev. 1 .0a, July 24, 2000, available from the 
aforesaid PCI Special Interest Group, Portland, Oregon, U.S.A. (hereinafter referred to as a 
"PCI-X bus"). 

The user interface 116 may include one or more devices for a human user to input 
commands and/or data and/or to monitor the system 100 such as, for example, a keyboard, 

15 pointing device, and/or video display. The chipset 1 14 may include a host bridge/hub system 
(not shown) that couples the processor 1 12, system memory 121, and user interface system 116 
to each other and to the bus 122. Chipset 114 may include one or more integrated circuit chips, 
such as those selected from integrated circuit chipsets commercially available from the Assignee 
of the subject application (e.g., graphics memory and input/output (I/O) controller hub chipsets), 

20 although other integrated circuit chips may also, or alternatively be used. The processor 1 12, 
system memory 121, chipset 1 14, bus 122, and circuit card slot 130 may be on one circuit board 
132 such as a system motherboard. 
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The circuit card 120 may be constructed to permit it to be inserted into the circuit card 
slot 130. When the circuit card 120 is properly inserted into the slot 130, connectors 134 and 
137 become electrically and mechanically coupled to each other. When connectors 134 and 137 
are so coupled to each other, the circuit card 120 becomes electrically coupled to bus 122 and 
5 may exchange data and/or commands with system memory 121, host processor 1 12, and/or user 
interface system 1 16 via bus 122 and chipset 114. 

Alternatively, without departing from this embodiment, the operative circuitry of the 
circuit card 120 may be included in other structures, systems, and/or devices. These other 
structures, systems, and/or devices may be, for example, in the motherboard 132, and coupled to 
1 0 the bus 1 22 or in a chipset, e.g. , chipset 114. 

The circuit card 120 may communicate with the mass storage device 104 via one or 
more communication links 106 using one or more communication protocols. A plurality of 
frames 170 may be transmitted over the communication link. 106. A "frame" as used herein may 
comprise one or more symbols and values. A large number of frames from different devices 

15 such as mass storage devices and HBAs may be transmitted over communication links 106. The 
mass storage device 104 may include one or more mass storage devices, e.g., one or more 
redundant array of independent disks (RAID) 1 85 and/or peripheral devices. Exemplary 
communication protocols may include Fibre Channel (FC), Serial Advanced Technology 
Attachment (S-ATA), Serial Attached Small Computer Systems Interface (SAS) protocol, 

20 internet Small Computer System Interface (iSCSI), and/or asynchronous transfer mode (ATM). 

If a FC protocol is used by circuit card 120 to exchange data and/or commands with the 
mass storage device 104, it may comply or be compatible with the interface/protocol described in 
ANSI Standard Fibre Channel (FC) Physical and Signaling Interface-3 X3.303:1998 
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Specification. Alternatively, if a S-ATA protocol is used by circuit card 120 to exchange data 
and/or commands with mass storage 104, it may comply or be compatible with the protocol 
described in "Serial ATA: High Speed Serialized AT Attachment," Revision 1 .0, published on 
August 29, 2001 by the Serial ATA Working Group. Further alternatively, if a SAS protocol is 
5 used by circuit card 120 to exchange data and/or commands with mass storage 104, it may 
comply or be compatible with the protocol described in "Information Technology - Serial 
Attached SCSI -1.1 (SAS)," Working Draft American National Standard of International 
Committee For Information Technology Standards (INCITS) T10 Technical Committee, Project 
Tl 0/1 562-D, Revision 1, published September 18, 2003, by American National Standards 

10 Institute (hereinafter termed the "SAS Standard") and/or later-published versions of the SAS 
Standard. Further alternatively, if an iSCSI protocol is used by circuit card 120 to exchange 
data and/or commands with mass storage 104, it may comply or be compatible with the protocol 
described in "IP Storage Working Group, Internet Draft, draft-itef-ips-iscsi-20.txt", published 
January 13, 2003 by the Internet Engineering Task Force (ITEF) and/or later published versions 

15 of the same. Further alternatively, if an ATM protocol is used by circuit card 120 to exchange 
data and/or commands with mass storage 104, it may comply or be compatible with the plurality 
of ATM Standards approved by the ATM Forum including, for example, "Frame Based ATM 
Transport over Ethernet" published July, 2002 by the ATM Forum. 

FIG. 2A is a diagram of communication circuitry 140 consistent with one embodiment of 

20 the invention that may be included on the circuit card 120 of FIG. 1. Alternatively, the circuitry 
140 may be included in other structures and systems, e.g., in the motherboard 132 and coupled to 
the bus 122, such as, for example, in the chipset 1 14 and/or in other devices. As used herein, 
"circuitry" may comprise, for example, singly or in any combination, hardwired circuitry, 
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programmable circuitry, state machine circuitry, and/or firmware that stores instructions 
executed by programmable circuitry. 

The communication circuitry 140 may generally include transmit circuitry 202, receive 
circuitry 204, and memory 203. Other communication circuitry 140 may be for transmit only 
5 devices and hence have only the transmit circuitry 202, or may be for receive only devices and 
hence have only the receive circuitry 204. The memory 203 may include one or more machine 
readable media such as random-access memory (RAM), dynamic RAM (DRAM), magnetic disk 
(e.g. floppy disk and hard drive) memory, optical disk (e.g. CD-ROM) memory, and/or any other 
device that can store information. The memory 203 may be comprised in circuitry 140 or on 

10 other circuitry in the circuit card 120 or/or elsewhere in the system 100. The transmit circuitry 
202 and receive circuitry 204 are shown as sharing memory 203, however, each circuitry 202, 
204 may also have its own separate memory. 

In general, transmit circuitry 202 may accept one or more data blocks 210a, 210b, 210c 
from other circuitry and insert one or more data blocks within one or more frames 170a, 170b, 

15 170c as further detailed herein. As used herein, a "data block" may comprise a predetermined 
fixed size unit comprising a sequence of one or more symbols and values. In doing so, one 
portion of one data block, e.g., block 210a, may be inserted in one frame, e.g., frame 170a, while 
another portion of the same data block may be positioned in another frame, e.g., frame 170b. 
Therefore, efficiency of utilization of the frames in system 100 may be improved compared to 

20 the prior art wherein each data frame includes only a whole number of data blocks. Similarly, in 
general receive circuitry 204 may accept one or more frames 1 70d, 1 70e, 1 70f from the 
communication link 106 where at least one frame has a portion of a data block and another frame 
has another portion of the same data block. To handle a partial data block within a frame, both 
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the transmit 202 and receive 204 circuitry generally direct saving and retrieving of context data 
relating to the segmentation of the data block as is further detailed herein. 

An exemplary table 280 of context data that may be stored in memory 203 is illustrated in 
FIG. 2B. The table 280 may include various context data, including, but not limited to, a data 
5 block identification portion 282, an I/O device identifying portion 284, and an offset portion 286 
representative of the segmentation point between a first portion of data from a data block in one 
frame and a second portion of data from the same data block in another frame. The table 280 
may also include an intermediate error checking calculation result 288. The various exemplary 
portions 282, 284, 286, 288 of context data will be explained in more detail relative to FIG. 3 A. 

10 FIG. 3 A illustrates an exemplary sequence of frames 170g, 170h, 170i, 170j that may 

either be transmitted or received by the respective transmit and receive circuitry 202, 204 of FIG. 
2 A. Advantageously, the four frames 170g, 170h, 170i, 170j include six data blocks 210d, 210e, 
21 Of, 210g, 21 Oh, 210i for improved utilization of space within the frames. FIG. 3B illustrates in 
greater detail the exemplary data block 210e where a first portion of the data block 210e is in the 

1 5 first frame 170g and a second portion, in this case a remaining portion, is in the second frame 
170h. 

As illustrated in FIG. 3B, the exemplary data block 210e may be a protected data block. 
As used herein, a "protected data block" includes a data block having a data protection portion 
that may facilitate checking for one or more errors in the data block. In the embodiment as 
20 detailed in FIG. 3B, the exemplary protected data block 210e has a data portion 381 and a data 
protection portion 383 for facilitating checking for errors in the data portion 381 . The data 
portion 381 may comprise a plurality of bytes of data to be transmitted between a transmitting 
device and receiving device. The protected data block 210e may have a size 390, e.g., about 
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524 bytes in one embodiment, of which the data portion 381 has a size 392, e.g., about 516 bytes 
in one embodiment, and the data protection portion 383 has a size 396, e.g., about 8 bytes in one 
embodiment. The data protection portion 383 may include an error checking portion 385, e.g., a 
block guard portion, having a size 394 and other data protection tools such as an incrementing 
5 logical block address (LBA) tag and an application defined tag. 

The error checking portion 385 may include one or more error checking codes based 
upon which the integrity of the data transmitted between a sending and receiving device may be 
checked and verified. For example, the transmit circuit 202 may have error checking circuitry 
21 1 to calculate and append an error checking code in the error checking portion 385. 

10 Exemplary error checking circuitry may utilize a cyclic redundancy checking engine to apply a 
16 bit polynomial calculation to the data portion 381 that is being transmitted to derive a cyclic 
redundancy code (CRC), e.g., a two-byte CRC. 

The receiving device may also have error checking circuitry 215 in the receive circuitry 
204 that applies the same polynomial calculation to the data portion of the data received and may 

15 compare the result of the other calculation with the CRC code appended by the sending device. 
If the appended code and the result match, then the data in the data portion 381 is determined by 
circuitry 215 to have been sent successfully. If they do not agree, circuitry 215 may signal the 
sending device that an error in transmission has occurred and may request that the data be resent. 
The data protection portion 383 may comply or be compatible with, for example, the data 

20 protection techniques disclosed in "4.5 Protection Information Model (new section)," T10/03- 
176 revision 9, End-to-End Data Protection Document published by T 10, a Technical Committee 
of Accredited Standards Committee INCITS (International Committee for Information 
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Technology Standards) on October 22, 2003 ("the Model") and/or other and/or later developed 
versions of the Model. 

Being able to place a portion of a data block within one frame and another portion of the 
same data block within another frame, in accordance with this embodiment, enables efficiency of 
5 utilization of the frames to be increased compared to the prior art. Again, to handle partial 
distribution of data blocks within frames, both the transmit 202 and receive 204 circuitry may 
direct saving and retrieving of context data relating to the segmentation of the data block in the 
frames as is further detailed herein. 

For instance, at the end of the transmission or reception of the first frame 170g, e.g., time 
10 tl, the context data for the second data block 210e may be stored in memory 203, e.g., in the 
exemplary table 280. In general, the context data may include identification information for the 
second data block 210e, an indication of where the protected data block 210e was segmented 
(e.g., a relative offset value indicating the last byte of the data block 210e to be transmitted or 
received), and an intermediate error checking result associated with that portion of the data from 
1 5 the data block 2 1 Oe transmitted or received in that frame 1 1 7g. Such information may be stored 
in the data block identification portion 282, the offset portion 286, and the intermediate error 
checking result portion 288 of the exemplary table 280 illustrated in FIG. 2B. 

In operation, the transmit circuitry 202 receives one or more data blocks. The transmit 
circuitry 203 may then transmit one or more partial data blocks in an associated frame payload. 
20 For instance, a portion of the second data block 210e of FIG. 3 A may be transmitted in the first 
frame 170g. For such a partially transmitted data block 210e, transmit circuitry 202, e.g., via 
error checking circuitry 211, may perform an error checking calculation for the corresponding 
amount of transmitted bytes and develop an intermediate error checking calculation result. As 
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used herein, an "intermediate error checking result" may comprise a calculated error checking 
result based, at least in part, on data received from one or more partially received protected data 
blocks. Also as used herein, a "final error checking result" may comprise, at least in part, a 
calculated error checking result based on data from an entire protected data block. 
5 The transmit circuitry 202, e.g., using a memory controller 214, such as a direct memory 

access (DMA) controller, may then direct storage of the intermediate error checking result and 
the associated offset value in locations of memory 203. As used herein, an "offset value" may 
represent a last transmitted or received data bit of a transmitted or received, respectively, partial 
protected data block upon which an intermediate error checking result is, at least in part, based. 

10 These values may then be stored in the intermediate error checking result portion 288 and the 
offset portion 286 of the exemplary table 280. The memory address location may also contain 
identifying data for the partially transmitted data block 210e. This may be stored in the block 
identification portion 282 of the exemplary table 280. 

When the next frame 170h containing the remainder of the block 210e is transmitted, the 

1 5 context data for the partially transmitted block 2 1 Oe may be restored by the transmit circuitry 

202. This may include the intermediate error checking result and associated offset. The transmit 
circuitry 202, e.g., via the error checking circuitry 211, may then continue with its error checking 
calculation using the restored intermediate error checking result as a seed value, to develop an 
error code, e.g., a CRC code, to append to an end of the data block 210e. A similar process 

20 continues at the end of each frame 1 17h, 1 17i to enable increased efficiency of utilization of the 
frame regardless of frame or data block size. 

The receive circuitry 204 may operate in a similar fashion as the transmit circuitry 202. 
That is, the receive circuitry 204 may receive a frame payload that may contain a partial portion 
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of a data block placed in an associated frame. For instance, the receive circuitry 204 may receive 
frame 170g having a portion of data block 210e. For such a partially received protected data 
block 210e, the receive circuit, e.g., using an error checking engine 215, performs an error 
checking calculation for the corresponding amount of received bytes and develops an 
5 intermediate error checking calculation result. The receive circuitry 204, e.g., using a memory 
controller 217 such as a DMA controller, may then direct storage of the intermediate result and 
the associated offset in a memory address location of memory 203. The memory address 
location may also contain identifying data for the partially transmitted protected data block 210e. 
When the next frame 170h containing the remainder of the block 210e is received, the 

10 receive circuitry 204 may restore the stored context for data block 210e, e.g., using memory 
controller 217. The restored context may include the intermediate error checking result and 
associated offset corresponding to this result. The receive circuit, e.g., using error checking 
circuit 215, may then continue with its error checking calculation to develop an error code, e.g., a 
CRC code, to compare with the error checking code appended on the transmitting end. This 

1 5 process may continue at the end of each frame to enable increased efficiency of utilization of the 
frame regardless of frame or protected data block size. 

FIG. 4 is a diagram of another exemplary sequence of frames 170k, 1701, 170m, 170n, 
170o, 170p that may either be transmitted or received by the respective transmit and receive 
circuitry 202, 204 of FIG. 2 A. A plurality of data blocks 210j, 210k, 2101 may be distributed in 

20 the frames 170k, 1701, 170m, 170n, 170o, 170p. In contrast to the sequence of FIG. 3 A, the size 
of each of the frames 170k, 1701, 170m, 170n, 170o, 170p may be smaller than the size of the 
data blocks 210j, 210k, 2101. 
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Other than the relative size of the data blocks compared to the frames, the operation of 
transmitting and receiving such data blocks 210j, 210k, 2101 in such frames 170k, 1701, 170m, 
170n, 170o, 170p may be similar to the operations described with reference to FIG. 3 A. That is, 
at the end of frame 170k, context data may be stored for protected data block 210j. This context 
5 data may include identification information for the data block 210j, an indication of where the 
protected data block 210j was separated (e.g., a relative offset value indicating which was the last 
byte of the protected data block 210j in the frame 170k), and the intermediate error checking 
calculation associated with such data. This saved context data may then be restored upon receipt 
of the remainder of the data from the data block 210j or at the start of the second frame 1701. 

10 This process may continue similarly frames 170k, 1701, 170m, 170n, 170o, 170p have been 
transmitted or received. 

FIG. 5 is a flow chart of exemplary transmission operations 500 consistent with an 
embodiment of the invention. In operation 502, at least one of transmitting and receiving a first 
portion of a first protected data block within a first frame is accomplished. For example, a first 

1 5 portion of the protected data block 2 1 Oe may be transmitted or received within one frame 1 70g 
(see FIG. 3A). In operation 504, at least one of transmitting and receiving a second portion of 
the first protected data block within a second frame is accomplished. This second portion may 
include the remaining portion of the data block or there may be further portions of the data block 
in additional frames. For example, a second portion of block 210e, in this case a remaining 

20 portion may be transmitted or received in frame 1 70h. 
Out of order frame handling 

Occasionally, the incoming frames of a particular flow may be received out of order or 
out of sequence! If the first out of order frame received has a new protected data block starting at 
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the beginning of the out of order frame received, out of order frames may be processed without 
waiting for the missing frame from the sequence. For example, if a transmitted frame sequence 
comprising frames 0, 1, 2, 3, 4, and 5 was received as frames 0, 1, 3, 4, 5, and 2, the first out of 
order frame (frame 3) may be analyzed to determine if a new protected data block started at the 
5 start of frame 3. If so, then processing of the data blocks in frame 3, 4, and 5 would continue 
without waiting for the missing frame 2. 

This can be accomplished by assigning a new error checking intermediate saving 
context location in memory 203 for the out of order frames, e.g., frames 3, 4, and 5 in the present 
example. When the missing frame, e.g., frame 2 is received, any partial data block and any 

10 associated intermediate error checking calculation result associated with the received portion of 
the first frame 1, may be utilized to continue or finish the error checking calculation associated 
with that protected data block. For instance, the first frame 1 may be similar to frame 170g and 
the second frame may be similar to frame 170h of FIG. 3 A such that once frame 170h is 
received, the intermediate error checking calculation result from the portion of the protected data 

1 5 block 2 1 Oe in frame 1 70g may be utilized to calculate a final error checking calculation result for 
protected data block 210e. As such, queing out of order frames may increase performance by 
enabling analysis of such out of order frames without waiting for receipt of a missing frame. 

FIG. 6 is a flow chart of exemplary operations 600 of handling out of order frames 
consistent with an embodiment of the invention. The operations include receiving a plurality of 

20 sequentially transmitted frames including a first and second frame. A first portion of a first 

protected data block is received within the first frame and a second portion of the first protected 
data block is received within a second frame, and at least one of the sequentially transmitted 
frames is received out of order in operation 602. The operations 600 may also include analyzing 
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a second protected block of the at least one out of order frame for an error if the second protected 
data block starts concurrently with the at least one out of order frame in operation 604. 

It will be appreciated that the functionality described for all the embodiments described 
herein may be implemented using hardware, firmware, software, or a combination thereof. If 
5 implemented in software, instructions adapted to be executed by a machine may be stored on 
machine-readable media. Some examples of such machine-readable media include, but are not 
limited to, read-only memory (ROM), random-access memory (RAM), programmable ROM 
(PROM), erasable programmable ROM (EPROM), electronically erasable programmable ROM 
(EEPROM), dynamic RAM (DRAM), magnetic disk (e.g. floppy disk and hard drive), optical 

10 disk (e.g. CD-ROM), and any other device that can store information. In one embodiment, the 
instructions are stored on the medium in a compressed and/or encrypted format. 

Thus, in summary one embodiment may comprise a method. The method may include at 
least one of transmitting and receiving a first portion of a first protected data block within a first 
frame; and at least one of transmitting and receiving a second portion of the first protected data 

15 block within a second frame. 

There is also provided an article. The article may comprise a storage medium having 
stored thereon instructions that when executed by a machine result in the machine performing 
operations comprising: at least one of transmitting and receiving a first portion of a first 
protected data block within a first frame; and at least one of transmitting and receiving a second 

20 portion of the first protected data block within a second frame. 

The embodiments that have been described herein are set forth here by way of illustration 
but not of limitation. It is obvious that many other embodiments, which will be readily apparent 
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to those skilled in the art, may be made without departing from the spirit and scope of the 
appended claims. 
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